Architecture of a multi-modal dialogue system oriented to multilingual question-answering
نویسندگان
چکیده
In this paper, a proposal of a multi-modal dialogue system oriented to multilingual questionanswering is presented. This system includes the following ways of access: voice, text, avatar, gestures and signs language. The proposal is oriented to the question-answering task as a user interaction mechanism. The proposal here presented is in the first stages of its development phase and the architecture is presented for the first time on the base of the experiences in question-answering and dialogues previously developed. The main objective of this research work is the development of a solid platform that will permit the modular integration of the proposed architecture.
منابع مشابه
Vidiam: Corpus-based Development of a Dialogue Manager for Multimodal Question Answering
In this chapter we describe the Vidiam project, which concerns the development of a dialogue management system for multi-modal question answering dialogues as it was carried out in the IMIX project. The approach that was followed is data-driven, that is, corpus-based. Since research in Question Answering Dialog for multi-modal information retrieval is still new, no suitable corpora were availab...
متن کاملA Novel Method for Automatically Generating Multi-Modal Dialogue from Text
In this article, we propose a novel method for generating engaging multi-modal content automatically from text. Rhetorical Structure Theory (RST) is used to decompose text into discourse units and to identify rhetorical discourse relations between them. Rhetorical relations are then mapped to question–answer pairs in an information preserving way, i.e., the original text and the resulting dialo...
متن کاملBook Review: Interactive Multi-Modal Question-Answering by Antal van den Bosch and Gosse Bouma
Processing and presentation of multimodal information was one of the important directions pursued by researchers in the areas related to information processing and management in the first decade of this century and was funded by the Netherlands Organisation for Scientific Research (NWO), adhered to this direction of research. This book contains a collection of articles describing research carri...
متن کاملHyperarticulation of Corrections in Multilingual Dialogue Systems
This present paper aims at answering the question whether there are distinctive cross-linguistic differences associated with hyperarticulated speech in correction dialogue acts. The objective is to assess the effort for adaptation of a multilingual dialogue system in 9 different languages, regarding the recovery strategies, particularly corrections. If the presence of hyperarticulation signific...
متن کاملMultilingual Question/Answering: the DIOGENE System
This paper presents the DIOGENE question/answering system developed at ITCIrst. The system is based on a rather standard architecture which includes three components for question processing, search and answer extraction. Linguistic processing strongly relies on MULTIWORDNET, an extended version of the English WORDNET. The system has been designed to address two promising directions: multilingua...
متن کامل